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Abstract 

Economists were content with the concept of the Nash equiUbrium as game theory's solution 

• concept until Daskalakis, Goldberg, and Papadimitriou showed that finding a Nash equilibrium 

f— ^ is most likely a computationally hard problem, a result that set off a deep scientific crisis. 

^SJ Motivated, in part, by their result, in this paper, we propose a general theory of equilibrium 

; I behavior in vector fields (and, therefore, also noncooperative games). Our line of discourse is to 

C^ show that these universal in nature mathematical objects are endowed with significant structure, 

■^T which we probe to unearth atypical, previously unidentified, equilibrium behavior. 

I — I 1 Introduction 

H 

^^ There is evidence in the literature that various independently founded disciplines (including game 

c/^ theory, nonlinear optimization theory, and dynamical systems theory) have in fact been founded on 

I ^1 variations of the same concept with the formahzation of the variational inequality problem being a 

case in point. In the finite-dimensional variational inequality problem (for example, see [3]), we are 

K^ given a set X C M'", which is typically assumed to be nonempty, closed, and convex, and a vector 

l/^ field c : M™" — )• M™, and our objective is to find a vector x* £ X such that 

l> 

^n (x-x*)-c(x*) > 0,VxeX 



X 



'^ We will refer to the solutions of the variational inequality problem as the critical elements of the 

Z^ vector field {X, c) . The concept of critical elements has been shown to coincide with the concept 

T— I of Nash equilibria (for example, see [15j), the concept of critical points of nonlinear optimization 

►;>. problems (for example, see [3]) and the concept of equilibria of dynamical systems (for example, 

see [8j). In this paper, we make a case toward unifying the foundations of the aforementioned 

disciplines by proposing a solution concept for a general vector field. The term solution concept is 

C^ to be understood in the sense of game theory, namely, a prediction on the behavior of a system. 

First we argue that critical elements do not qualify as a solution concept for a general vector field. 

1.1 Critical elements are not a solution concept 

Suppose momentarily that our effort to lay a foundation of a general theory of vector fields whose 
objective is to make predictions through its solution concept about the behavior of systems that 
evolve according to vector fields is a rightful pursuit. Then we claim that critical elements cannot 
be that solution concept. For if critical elements qualified as such a solution concept, they would 
certainly need to qualify as the solutions of vector fields that have special structure, such as, for 
example, gradient fields, that is, vector fields that are generated by taking the gradient of a scalar 
function. The problem of devising a solution concept for gradient fields has been the subject 
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of nonlinear optimization theory where it was recognized early on (in fact, by Ferniat himself 
who formulated optimization's first solution concepts) that critical elements are only a necessary 
optimality condition and by no means sufficient. (For example, consider the problem of optimizing 
f{x) = x^. In this problem, x = is a critical point, that is, a solution of the aforementioned 
variational inequality, whereas this point does not satisfy any intuitive notion of optimality.) 

In the same vein, since noncooperative games can also be represented as vector fields (for exam- 
ple, see p^), does there exist solid ground to justify accepting the concept of Nash equilibrium as 
game theory's solution concept? Our thesis is that it doesn't; for one thing, computing Nash equi- 
libria is most likely a computationally hard problem [7j. What's more, the intersection of nonlinear 
optimization problems and noncooperative games is not empty: Many interesting noncooperative 
games are gradient fields in that they admit a potential function (for example, see |14j). Since 
the potential function fully characterizes the incentive structure of games that have one, on what 
grounds should the critical points qualify as a solution concept for these games given that critical 
points do not qualify to be a solution concept in the general nonlinear optimization problem? 

1.2 If not critical elements, what then? 

Our thesis in this paper is that the pursuit of a general theory of vector fields is rightful, and to 
support this thesis we propose a general theory of equilibrium behavior. The formalization of such a 
theory may sound at first to be a formidable and copious task considering that the concept of vector 
fields is as universal in mathematics as the Turing machine is in computer science, if not more. We 
believe, however, that our line of discourse is easy to follow as, in fact, the foundation of the theory 
is based on an elementary and rather intuitive idea: The elements of a vector field are comparable, 
and, therefore, can be ordered, in a meaningful manner. Once this idea is in place the question of 
devising an appropriate means by which to order them becomes a simpler (although perhaps not 
straightforward) task. The induced order is not, to the extent of our knowledge, a mathematical 
structure known prior to this work, and we take the privilege of naming it a polyorder. 

1.3 The main ideas in our theory 

Consider a gradient field defined over a closed and convex set X C W^ and let / be its scalar 
potential function. Let x,y S X be arbitrary elements of this gradient field, and consider a 
(topological) path p m. X starting at x and ending at y whose image is the convex hull of x and y 
(that is, all convex combinations of x and y). Call p a descent path if the following conditions are 
met: (1) f{x) > f{y) and (2) / is everywhere nonascending along p. If these conditions are met 
order x and y such that y is "better than" x. Similarly, call p a ascent path if f{x) < f{y) and 
if / is everywhere nondescending along p, and, if so, order x and y such that x is "better than" 
y. A polyorder then, in this particular example of a gradient field, is the induced mathematical 
structure obtained by the pairwise comparison of all elements in the aforementioned way. 

Now, let x^jj^ be an element of X such that for all other elements x oi X the corresponding 
path from xjj^jj^ to x as defined above is not a descent path, and call such an element minimal; 
minimal elements are precisely those elements that are "no worse" than all other elements. Also, 
let xj^a^x be an element of X such that for all other elements x of X the corresponding path from 
^max to ^ is ''^^^ ^^ ascent path, and call such an element maximal; maximal elements are precisely 
those elements that are "no better" than all other elements. 

Every polyorder has a minimum solution concept and a maximum solution concept, the former 
being the set of all minimal elements of X and the latter being the set of all maximal elements of 
X. These ideas generalize to general vector fields, and such generalized orders form the basis of 



our theory of equilibrium behavior. One of the main contributions of this paper is to show how 
polyorders encompass various known concepts in nonhnear optimization theory and game theory 
and how they can evince interesting yet unidentified prior to this work behavior. 

The rest of this paper is organized as follows: We motivate and formalize our theory of equilibrium 
behavior in the next section, while in Section [3] we explore the precise relationship between our 
theory and the theories of nonlinear optimization and games. Thereafter, in Section |4j we study 
atypical previously unknown equilibrium behavior that our theory predicts. Finally, in Section [5j 
we discuss related work. 

2 Polytropic optimization: In search of equilibrium 

In this section, we formalize our theory. We start by motivating the ideas in this theory using ideas 
from nonlinear optimization theory and evolutionary game theory, then we introduce some basic 
concepts from the theory of preference relations, and, finally, we present a precise formalization of 
what we may call a general theory of equilibrium behavior in vector fields. 

2.1 Some motivating ideas in nonlinear programming 

We start off with some basic ideas from nonlinear programming, the algorithmic component of 
nonlinear optimization theory. The archetypical problem of nonlinear optimization theory is to 
"minimize" a scalar objective function f subject to a constraint set X C M™. In standard expositions 
of the theory, nonlinear programming algorithms would ideally compute global optima, an objective, 
however, that is out of the scope of existing algorithms. This observation motivates the study of 
algorithms with local convergence properties (for example, see [Ij) and the study of optimization 
problems where the concepts of local and global minima coincide (for example, see [6l|5]). 

Careful examination of the line of discourse of nonlinear optimization theory reveals that the 
concept of the objective function is not a first-order concept of this theory. Indeed, if the scope of 
nonlinear programming algorithms were to compute global optima, it would have been, however, 
as a point of fact, the objective function is only relevant inasmuch as it permits the convenient 
definition of descent directions. 

Given a point x in the constraint set X , a descent direction for this point is a vector in the 
corresponding tangent space of the constraint set such that the objective function / decreases 
locally. What nonlinear programming algorithms essentially do is to follow descent directions in 
carefully selected steps and stop at points lacking descent directions. The concept of a decent 
direction is, therefore, arguably more important than that of the objective function. 

Most texts on nonlinear optimization theory motivate the concepts of local minima and strict 
local minima as forming the basis of this theory's "solution concept" in the sense that once nonlinear 
programming algorithms (in their course of following descent directions) arrive at such points, they 
stop. In this perspective, this paper can be understood as the following thought experiment: What 
precisely are the points that lack descent directions and do the aforementioned minimality concepts 
suffice to characterize these points? The precise definition of a descent direction will turn out to 
be crucial in this thought experiment. 

2.2 Some motivating ideas in evolutionary game theory 

We continue with some basic ideas from evolutionary game theory whose fundamental object of 
study is the population game, which is typically understood as a mathematical model of the strategic 



interaction among a large number of anonymous infinitesimal agents. Mathematically population 
games are vector fields constrained on a polyhedron that in fact generalize normal- form games. 

2.2.1 Population games 

A population game is a pair {X,c). X, the game's state space or strategy profile space, has product 
form, i.e., X = Xi x • • • x Xn, where the Xj's are simplexes and i = 1, . . . ,n refers to a player 
position (or population). To each player position corresponds a set Si of rrii pure strategies and a 
mass uji > (the population mass). The strategy space Xi of player position i has the form 



X,, 



X e 






We refer to the elements of X as states or strategy profiles. Each strategy profile x £ X can be 
decomposed into a vector strategies, i.e., x = (xi, . . . jXn)'- Let m = X^i^^i- c : X — )• M*", the 
game's cost function, maps X, the game's state space, to vectors of costs where each position in 
the vector corresponds to a pure strategy. It is typically assumed that c is continuous. 

2.2.2 Solution concepts for population games 

Even before the result of Daskalakis et al. disputed the Nash equilibrium as game theory's solution 
concept, the theory of population games was based on equilibrium refinements such as the evolu- 
tionarily stable strategy [|T71 116] as well as variants and generalizations of this concept (for example, 
see [H]). In a manner analogous to nonlinear optimization theory, most texts on evolutionary 
game theory motivate the aforementioned equilibrium refinements as being this theory's "solution 
concept" in the sense that they are points (or sets thereof) where evolution stops. 

In contrast to nonlinear optimization theory where algorithmic ideas abound, evolutionary game 
theory is concerned perhaps exclusively with the concept of dynamics that although arguably would 
qualify as an inherently algorithmic concept from the perspective of computer scientists, it formally 
views evolution as a continuous-time process (with few exceptions). Evolutionarily stable strategies 
as well as their variants and generalizations have been shown to be attractive under a wide range 
of dynamics (including perhaps most prominently among them the replicator dynamic [H]). The 
precise definition of an evolutionarily stable strategy is based on an idea whose significance in our 
theory of equilibrium behavior cannot be understated. 

2.2.3 The concept of invasion 

One of the fundamental concepts in evolutionary game theory is that of invasion. Let {X, c) 
be a population game, and let x,y £ X. We say that x invades y if x ■ c{y) < y ■ c{y). The 
standard evolutionary interpretation of invasion is to consider a population of organisms that form 
a continuum mass, to interpret y as the state of this population, and y ■ c{y) as the survival cost 
of an organism being in that state. In this vein, x ■ c{y) is the survival cost of a mutant organism 
whose state switches from y to x. Then the condition that x invades y implies that the population 
of mutants will proliferate in the incumbent population due to the favorable survival cost. 

There is an alternative interpretation of the concept of invasion, one that is more in alignment 
with ideas in nonlinear optimization theory. To that end, let's write the condition that x invades y 
as {x — y) ■ c{y) < 0, and note that this implies that the angle between c(y) and (x — y) is obtuse. 
Stated differently, the projection of c{y) on the line segment connecting x and y "points away" from 



X. Suppose now that the vector field is the gradient field of a scalar potential. Then the condition 
that X invades y is precisely the condition that {x — y) is a descent direction of the scalar field at y 
(a simple fact which is easy to prove by a Taylor expansion). 

What if the vector field is not a gradient field though? Are we then justified to think of (x — y) as 
a "descent direction" in some sense? Our intuitive understanding of a descent direction stipulates 
that along such a direction the objective function must decrease locally, however, as discussed 
earlier in the setting of nonlinear optimization theory, the objective function is not a first order 
concept, and, therefore, the possibility of witnessing some other more elementary phenomenon than 
the descent of the potential function (one that transcends to general vector fields) is open. With 
the benefit of hindsight, we can indeed assert that what is happening at a more elementary level 
is what we may call the descent of an abstract notion of an "order," one we yet need to define. To 
that end, we turn to some foundational ideas from the theory of preference relations. 

2.3 Some ideas in preference relations theory 

Let X be a nonempty set. A subset R of X x X is called a binary relation on X. If {x, y) G R, 
we write xRy, and if (x, y) R, we write -^xRy. R is called reflexive if xRx for each x & X and 
complete if for each x, y G X either xRy or yRx. It is called symmetric if, for any x, y G X, we 
have that xRy =^ yRx, and antisymmetric if, for any x, y G X, xRy A yRx =^ x = y. Finally, R is 
called transitive if for any x,y,z G X we have that xRy and yRz imply xRz. 

Let xPy <^ xRy A -^yRx and xly <^ xRy A yRx. Then P and I are also binary relations on 
X where P <^ R and I Q R. P is called the asymmetric (or strict) part of R and / is called its 
symmetric part. If P is antisymmetric, then R is called a preference relation. 

Preference relations are a fundamental object of study of microeconomic theory. The most 
elementary problem in this theory is that of individual decision making (see, for example, [I^) 
whose starting point is a set of alternatives (say X) among which an individual must choose. 
A fundamental tenet of microeconomic theory (since the definitive work of Von Neumann and 
Morgernstern |llj ) is that individual preferences are rational. 

Definition 1. The preference relation R is rational if it is complete and transitive. 

The study of transitive preference relations is the subject of order theory (for example, see ^12j): 
although this theory is of considerable intellectual merit, in the rest of this paper, we will be 
concerned with preference relations that are generally non-transitive. 

If a preference relation is not transitive, one would hope that it is perhaps acyclic. 

Definition 2. The preference relation R is acyclic if there is no finite set {xi, . . . ,x„} C X such 
that XiRxi^i for i = 1, . . . ,n — 1 and such that x„i?xi. 

There is a growing theory of acyclic preference relations (for example, see [2t l20i [Hll3|). however, 
the preference relations we will be concerned with are in general not even acyclic. 

Definition 3. Let R be a preference relation on X and let x,y G X. If xPy, where P is the 
asymmetric part of R, we say that x dominates y. We further say that an element of X is minimal 
(or undominatedj if there is no element in X that dominates it. We, finally, say that an element 
of X is maximal if there no element in X that it dominates. 

2.4 Polyorders and polytropic optimization 

In the rest of this section, we introduce our solution concepts for scalar and vector fields. 



2.4.1 Preliminaries 

Before defining our solution concepts, however, let's ponder momentarily why critical elements 
do not qualify as such. It seems intuitive to us that, in any sensible notion of optimality, points 
where it is possible to descend from locally should not qualify as being optimal, and it is precisely 
this notion of optimality that critical elements fail to pass. Consider, for example, the problem of 
minimizing a scalar field and an interior strict local maximum of this field. It is easy to see that the 
(interior) strict local maximizer is a critical element as its gradient vanishes. However, starting from 
the maximizer and following any direction in the tangent space, the objective function clearly does 
decrease, and, therefore, the maximizer cannot qualify as a solution to our minimization problem. 
Our definition of an appropriate solution concept will be based on the machinery of the theory of 
preference relations, and, in particular, the concept of minimal or undom,inated elements. You may 
observe in the previous definition of minimality that it is a concept defined by a property that it 
lacks, and since we are interested in mathematically capturing the idea of points that lack descent 
directions, this confluence is particularly suiting. However, devising an appropriate preference 
ordering is not a straightforward task. To see this, recall the definition of critical elements: Given 
a vector field c : X — )■ M™", x* G X is a critical element if 

(x-x*)-c(x*) > 0,VxG X. 

Notice in the definition that critical elements are also defined by what they lack: x* is a critical 
element precisely when it is uninvadahle. Our solution concept requires a new, but straightforward 
in its formalism, mathematical concept, which we are going to call weak dominance in whose 
definition we will need the following elementary definition from topology. 

Definition 4. A path p in X CI M™ is a continuous map p : [0, 1] — )■ X . 

2.4.2 Linear scalar polyorders 

Let f '■ X CI M™ — )• M be a continuous scalar field where X is closed and convex. Let x,y £ X, and 
define a path y^ '■ [0, 1] — )■ X such that y^ = ex + (1 — e)y. Let ^/ be a preference relation on X 
such that 



x^fy^yei,e2€ [0, 1] : ei < es ^ f{ye,) > f{y, 



<S2j 



If X :<f y, we say that y^ is a path of weak ascent from x to y (and a path of weak descent from y 
to x). We call {X, :<f) a linear scalar polyorder. (Note that y^^ is "closer" to y than i/ej-) 

Proposition 1. If x ~<f y, then /(x) < f{y). 

Proof. Since x -<f y, we have that x <f y and -i(y ^/ x). Since x ^/ y, we have that Vei,e2 G 
[0,1] : ei < £2 =^ fiVei) > f{ye2)- Furthermore, since -^{y :<f x), there exist ei,e2 G [0,1], where 
ei < €2 such that /(yei) > fiVei)- Since, /(x) < /(yea) and /(y^i) < /(y), the proof is complete. D 

By virtue of the previous proposition, if x -<j y, we say that y^ is an ascent path from x to y 
(and that y — x is an ascent direction at x) and a descent path from y to x (and that x — y is a 
descent direction at y). However, note that an ascent or descent direction may not be locally so 
in the sense that in a neighborhood of the corresponding point it may well be the case that / is 
constant. 

Proposition 2. The strict part of a linear scalar polyorder is acyclic. 



Proof. Suppose there exists a finite set {xi, . . . , x„} C X such that Xj -<j Xj+i for i = 1, . . . , n — 1 
and such that Xn -</ xi. Then /(xj) < /(xj+i) for i = l,...,n — 1 and f{xn) < /(xi), which 
contradicts the assumption that / is single- valued. D 

The previous concepts naturally generalize to general vector fields as shown next. 

2.4.3 Linear vector polyorders 

Let c : X CI R™ — > M™ be a continuous vector field where X is closed and convex. Let x,y £ X, 
and define a path y^ : [0, 1] — )■ X such that y^ = ex + (1 — €)y. Let ^c be a preference relation on 
X such that 

a; ^c y <^ Ve e [0, 1] : X • c(yj < y • c(ye)- 

If a; ^c y, we say that x weakly dominates y. We call {X, :<c) a linear vector polyorder. We may 
understand weak dominance as follows: If x weakly dominates y, for all e € [0, 1], the projection of 
c{ye) on the path y^ does not point toward x. 

Proposition 3. //x -<c y, i/ien Ve G [0, 1] : x • c{ye) < y • c(ye) and 3e € [0, 1] : x • c(ye) < y • c{ye)- 

Proposition 4. The strict part of a linear vector polyorder is antisymmetric. 

Proof. The proof easily follows from the previous proposition. D 

We now show that the concept of 'weak dominance' generalizes the concept of 'weak descent'. 

Proposition 5. Let c : M™ — > M™ be a continuous vector field and let c : X CI M™ — > R™ be 
its restriction to the closed and convex set X . Suppose that c is a gradient field and let f be its 
potential function. Then x ^c V "^ x :<f y. 

Proof. We show that x ^c y ^ x ^j y, noting that the reverse direction is completely analogous. 
To that end, let x,y £ X such that x :<c y, and suppose there exist ei,e2 G [0, 1] where ei < £2 
such that f{yei) < fiyt2)- Then by the mean value theorem there exists e G (ei, €2) such that 

V/(ye) ■{x-y) = -^—Vf{y,) ■ {y,, - y,,) = f{y,,) - f{y,,) > 0. 
£2 - ei 

This contradicts our assumption that x ^c V- D 

2.4.4 Solution concepts for scalar and vector fields 

What we have so far accomplished is to introduce natural, we believe, orderings of general scalar 
and vector fields. It is now a small step to define our solution concepts based on these orderings, 
definitions which we state as the following theses. 

Thesis 1 (First fundamental thesis of poly tropic optimization). The minimum (resp. max- 
imum) solution concept of a continuous scalar field that is defined over a closed and convex domain 
is the set of minimal (resp. maximal) elements of its linear scalar polyorder. 

Thesis 2 (Second fundamental thesis of polytropic optimization). The minimum (resp. 
maximum) equilibrium solution concept of a continuous vector field that is defined over a closed 
and convex domain is the set of minimal (resp. maximal) elements of its linear vector polyorder. 



We will refer to the problem of "solving" linear scalar and vector polyorders in the sense defined 
above as polytropic optimization. The minimal solutions of a polytropic optimization problem are 
precisely those points that lack directions of descent, and it is now easy to verify that strict local 
maxima, for example, do not qualify as solutions of a minimization problem. Our claim, however, 
is much stronger: We claim that our solution concepts are a precise characterization of the intuitive 
notion of optimality. To support our theses, we explore, in the next section, the precise relationship 
between our theory and the theories of nonlinear optimization and evolutionary games. 

3 Relationship with the theories of nonUnear optimization and 
evolutionary games 

Following preliminary results, we show, in this section, that minimal and maximal elements are 
necessarily critical elements, and, in this sense, our solution concept is an equilibrium refinement 
concept. Then we show that optimization theory's strict local minima as well evolutionary game 
theory's evolutionarily stable states are minimal. Therefore, our equilibrium refinement concept 
encompasses the most widely applied solution concepts in these theories. 

Thereafter, we explore the relationship between minimality and the concepts of local minimum 
and neutrally stable state. We provide examples showing that these concepts do not qualify as 
"solution concepts" in their respective theories and indeed they are not used as such. Our under- 
standing from standard expositions of these theories is that local minima and neutrally stable states 
are equilibrium refinements that are necessary for optimality in that all optimal solutions of a non- 
linear optimization problem should be local minima and that all optimal solutions of a population 
game should be neutrally stable. Indeed, evolutionary game theory's most general, to the extent 
of our knowledge, solution concept (one that encompasses the concept of an evolutionarily stable 
state) is that of an evolutionarily stable set [19J (see also |21] ) all of whose members are neutrally 
stable. Nonlinear optimization theory is not equipped with an analogue of the evolutionarily stable 
set, but it is easy to devise one. We prove in this section that these quite general solution concepts 
are encompassed in the notion of minimality, which is an intuitively pleasing result. 

What's more, we show that minimality is a more general concept than all known prior to this 
paper solution concepts in a strong sense: Minimal elements are not necessarily local minima. The 
counterexample we provide is a mathematically interesting object to which we devote Section |4j 

3.1 Preliminaries: Minimal and maximal elements 

In this section, we assume that X is a closed and convex subset of M*", and that c : X — t- M™ and 
/ : X — )• M are continuous. 

Definition 5. x* is :<c-minimal if\/x G X : -i(x -<c x*). It is :<c-maximal if\/x £ X : -i(x* -<c x). 

The concepts of ^j-minimality and ^j-maximality have analogous definitions. The concepts 
of minimality and maximality have the following equivalent characterizations. 

Lemma 1. Let x* £ X and, for any x £ X , let x^ = ex* + (1 — e)x. 
(i) x* is :<c-minimal if and only if 

\fx : (Ve G [0, 1] : x* ■ c{xe) < x ■ c(x,)) V (3e G [0, 1] : x* ■ c{x^) < x ■ c{x^)). 

(a) x* is :<c-maximal if and only if 

\/x : (Ve G [0, 1] : x* ■ c(x,) > x ■ c(x,)) V (3e G [0, 1] : x* • c(x,) > x ■ c(xe)). 



(in) X* is <f -minimal if and only if 

Vx : (Vei,e2 G [0,1] : ei < £3 ^ /(x,J > f{x^^)) V (3ei,e2 G [0,1] where ei < £2 : /(xej > /(xej). 

(^iuj x* is <f -maximal if and only if 

Vx : (Vei,e2 G [0,1] : ei < £2 ^ /(xej < /(x.J) V (3ei,e2 G [0,1] w/iere ei < £2 : /(xej < /(x.J). 

Proof. We only prove part (i) as the proofs of the other parts are analogous. 



X* is minimal <^ Vx 

<^ Vx 
<^ Vx 
<^ Vx 
44- Vx 
<^ Vx 



-i(x -< X*) 

^((x^x*) A^(x* ^x)) 

(x* < x) V^(x < X*) 

(Ve G [0, 1] : X* • c(x,) < x • c(x,)) V ^(Ve G [0, 1] : x • c{xl) < x* • c(x:)) 

(Ve G [0, 1] : X* • c(x,) < x • c(x,)) V (3e G [0, 1] : x • c(x:) > x* • c{xl)) 

(Ve G [0, 1] : X* • c(xe) < x • c(x,)) V (3e G [0, 1] : x* • c(xe) < x • c(xe)). D 



We are going to use the following proposition. 
Proposition 6. x* is ^c-i^'lnimal if and only if it is <^c-fnaximal. 
Proof. By Lemma [Tl x* is ^_c-maximal if and only if 

Vx : (Ve G [0, 1] : x* • (-c(x,)) > x • (-c(x,))) V (3e G [0, 1] : x* • (-c(x,)) > x • {-c{x,))). (1) 
Furthermore, by the same lemma, x* is ^c-minimal if and only if 

Vx : (Ve G [0, 1] : x* • c(x,) < x • c(x,)) V (3e G [0, 1] : x* • c(x,) < x • c(x,)). (2) 

But ([I]) and ([2]) are equivalent. D 

Finally, we state without proof the following proposition. 
Proposition 7. x* is :<f -minimal if and only if it is <^f -maximal. 

3.2 Critical elements 

First we show that the set of minimal elements is a subset of the set of critical elements. 

Definition 6. x* is a critical element of (X, c) if\/x£X:x- c(x*) > x* • c(x*). 

We are going to need the following lemma. 

Lemma 2. Ify-c{x) < x-c(x), then there exists e' G [0, 1] such that, Ve G [e', 1], y-c{ye) < x-c{ye) 
where y^ = ex + {1 — e)y. 

Proof. The proof is a simple implication of the continuity of {y — x) ■ c{ye). □ 

Theorem 1. If x* is :<c-m,inimal, then x* is a critical element of {X,c). 

Proof. Let x* be minimal and suppose that there exists x £ X such that x • c(x*) < x* • c(x*). 
Then, by Lemma[2J there exists an element in the convex hull of x* and x that dominates x*, which 
contradicts our assumption that x* is minimal. D 

9 



Note that the maximal elements of -<c are, in general, not a subset of the critical elements 
of (X, c). However, they are a subset of the critical elements of (X, — c), a fact that is a simple 
implication of Proposition [6j Furthermore, note the following: 

1. Since the maximal elements of (^, c) are the minimal elements of (X, — c), any theorem we 
prove below about minimal elements has an analogous statement for maximal elements. 

2. The set of critical elements may have members that are neither minimal nor maximal. Con- 
sider, for example, /(a;) = x^ ^x E M. Viewing / as a vector field, the origin is a critical 
element, but it is neither a minimal nor a maximal element (since the origin is dominated by 
every element of the left axis and dominates every element of the right axis). 

3.3 Strict local minima and evolutionarily stable states 

3.3.1 Linear vector polyorders 

Definition 7 (See [IS]), x* is an evolutionarily stable state of{X,c) if there exists a neighborhood 
O <^ X of X* such that\/x GO- {x*} : x* ■ c{x) < x ■ c{x). 

Theorem 2. If x* is an evolutionarily stable state of {X,c), then x* is :<c-niinimal. 

Proof. Let x^ = ex* + (1 — e)x, e E [0,1]. By Lemma [l] it suffices to show that for all x G X 
where x ^ x* there exists e G [0,1] such that x* ■ c(xe) < x ■ c(xe). By the assumption that 
X* is an evolutionarily stable state, for all x G O where x ^ x* there exists e G [0, 1] such that 
X* ■c{xe) < x^-c{Xf^), which is also certainly true for all x G X since O is a neighborhood; expanding 
Xe and rearranging proves the theorem. D 

3.3.2 Linear scalar polyorders 

Definition 8. x* is a strict local minimum of {X, f) if there exists a neighborhood O ^ X of x* 
such that Vx G O - {x*} : /(x*) < /(x). 

Theorem 3. If x* is a strict local minimum of (X,f), then x* is :<f -minimal. 

Proof. Let x^ = ex* + (1 — e)x, e G [0, 1]. By Lemmafll it suffices to show that for all x G X where 
X 7^ X* there exist ei,e2 G [0, 1] where ei < 62 such that /(x^^) > fi^x^^). Suppose, for the sake of 
contradiction, that this is false. Then, there exists, x £ O such that Vei,e2 G [0,1] with ei < €2, 
/(a^ei) < f{xe2)- But then /(x) < /(x*), which contradicts the assumption that x* is a strict local 
minimum. D 

3.4 Local minima, neutrally stable states, and evolutionarily stable sets 
3.4.1 Linear vector polyorders 

Consider the definition of a neutrally stable state in evolutionary game theory. 

Definition 9. x* is an neutrally stable state of {X, c) if there exists a neighborhood O C. X of x* 
such that Vx G O : X* • c(x) < x • c(x). 

We may also analogously define the concept of a local minimum of a vector polyorder. 

Definition 10. x* is a local minimum of {X, ^c) if there exists a neighborhood O Q X of x* such 
that Vx G O : X* ^c x. 

10 




Figure 1: An example showing a local minimum element that is not minimal. 

The concepts of local mininium of linear vector polyorders and of neutrally stable states are 
equivalent as the following theorem asserts. 

Theorem 4. x* is a neutrally stable state of{X,c) 4^ x* is a local minimum of {X,^c)- 

Proof. Let x* be a neutrally stable state of {X, c), and let x G O. Let x^ = ex* + (1 — e)x. Then, 
for all e S [0, 1], we have that 

X* ■ c{Xe) < Xe • c{Xf^) <^ X* ■ c(Xe) < {eX* + (1 — e)x) ■ c(Xe) 

<^ (1 — e)x* ■ c(xe) < (1 — e)x • c(xe) 

<^ X* ■ c(Xe) < X ■ c(Xe), 

and, therefore, x* :<c x. The reverse direction is analogous. D 

Next we show that local minima are critical elements. 

Theorem 5. If x* is a local minimum of {X, ^c)? then x* is a critical element of {X, c). 

Proof. Let x* be a local minimum of {X, ^c). Then there exists OCX such that Vx G O Ve G 
[0, 1] : X* ■ c{xe) < X ■ c(xe). Therefore, for all x £ O, x ■ c{x*) > x* ■ c{x*). Suppose now there exists 
x £ X — O such that x ■ c{x*) < x* ■ c(x*). Then, for all e G [0, 1], Xe • c{x*) < x* • c{x*), which 
contradicts the previous implication that, for all x G O, x • c(x*) > x* ■ c(x*). D 

However, as, for example, shown in Figure [T| a local minimum may not be minimal. 
Being a local minimum is a necessary condition in a generalization of the concept of the evolu- 
tionarily stable state, namely the evolutionarily stable set. 
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Figure 2; Used in the proof of Theorem pi 



Definition 11 (See [21j). X* is an evolutionarily stable set of{X,c) if it is nonempty and closed 
and if for each x* G X* there exists a neighborhood 0{x*) Q X of x* such that Vx G 0{x*) : 
X* ■ c{x) < X ■ c{x) with strict inequality if x ^ X* . 

Evolutionarily stable sets are minimal as the following theorem asserts. 

Theorem 6. Let X* be an evolutionarily stable set of [X,c), and let x* G X* . Then x* is :<c- 
minimal. 

Proof. By Lemma [T| it suffices to show that 

Vx G X : (Ve G [0, 1] : x* ■ c{x,) < x ■ c{x^)) V (3e G [0, 1] : x* ■ c{x^) < x ■ c(x,)). 

Note that it is trivially true (by the definition of an evolutionarily stable set) that 

Vx G 0{x*) : (Ve G [0, 1] : x* ■ c(xe) < x ■ c(xe)) V (3e G [0, 1] : x* ■ c{x,) < x ■ c(x,)). 

Therefore, take any x G X — 0{x*), and let Xe = ex* + (1 — e)x, e G [0, 1]. Let x^i be the point 
where x^ intersects the boundary of 0{x*) (pointed at by the arrow in Figure^, and note that to 
prove our claim we only need to consider the case that, for all e G [e', 1], x* • c{xe) = x^' ■ c(xe). Note 
further that in this case Xg' G X* and consider O(xe'). Let x^n be the point where x^ intersects 
the boundary of 0{x^i) (in the direction toward x). Observe now that if there exists C, G [e',e"] 
such that Xe' • c{xc) < x^" • c(x^), then there exists e G [e',e"] such that x* ■ c(xe) < x • c(xe), and 
that if no such ^ exists we may similarly consider the boundary point x^" of 0{x^i) noting that 
then, for all ( G [e',e"], x^i ■ c{x() = x^" ■ c(x^), and, therefore, that x^" G X* . Continuing in this 
way, we either obtain an e G [0, 1] such that x* • c(xe) < x • c(xe) or we have that, for all e G [0, 1], 
X* • c{xe) = X ■ c(xe). Since x is arbitrary, the theorem is proven. D 
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Figure 3: Rotating this function around the vertical axis (at x = 0) we obtain a scalar field whose 
global minima are not local minima of ^j. 

3.4.2 Linear scalar polyorders 

In the last part of this section, we explore the analogue of the concept of the evolutionarily stable set 
in scalar fields. To that end, consider the definition of a local minimum in nonlinear optimization. 

Definition 12. x* is a local m,inim,um, of {X, f) if there exists a neighborhood OCX of x* such 
thatyxe O: f{x*) <f{x). 

We may also analogously define the concept of a local minimum of a scalar polyorder. 

Definition 13. x* is a local minimum of {X, :<f) if there exists a neighborhood O ^ X of x* such 
that Mx £ O : X* <f x. 

We have the following theorem. 

Theorem 7. If x* is a local minimum of (X, ^/), then x* is a local minimum of (X, /). 

Proof. Since x* is a local minimum of (X, ^/), for all x G O, we have that, for all £1,62 G [0, 1] 
where ei < e2, f{xei) > /(x^a), which is certainly true if ei = and £2 = 1. □ 

However, the reverse direction is not generally true. For example, consider a scalar field / : 
R^ — )• M that is obtained by rotating the function in Figure p^ around the z-axis (the figure shows 
the intersection of such a function with the plane y = 0). It is easy to see in this example that the 
global minima of / are not local minima of :<f. (To see this note that the global minima of / form 
a circle and take any two points on this circle.) 

Since the local minima of a scalar field are not necessarily local minima of its corresponding 
scalar polyorder, we are motivated to strengthen the definition of an evolutionarily stable set in 
scalar fields by introducing a new concept, namely that of an almost strictly minimal set. 
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Definition 14. X* is an almost strictly minimal set of (X, /) if it is nonempty and closed and if 
for each x* £ X* there exists a neighborhood 0{x*) C X of x* such that\/x £ 0{x*) : f{x*) < f{x) 
with strict inequality if x ^ X* . 

We have the following theorem, which is a stronger form of Theorem [6j 

Theorem 8. Let X* he an almost strictly minimal set of (X, c), and let x* € X* . Then x* is 
<f -minimal. 

Proof. The proof is analogous to that of Theorem |6| however, it is worth noticing the subtle 
differences in the beginning of the proof. By Lemma [T| it suffices to show that 

Vx : (Vei,e2 G [0,1] : ei < £2 ^ /(xej > /(x.J) V (3ei,e2 G [0,1] where ei < e2 : /(xej > /(xea)). 

It is easy to show that the previous statement is true for all x G 0{x*). (The negation of the previous 
statement implies there exists a descent path starting at x* , which contradicts the assumption that 
X* is a local minimum.) Therefore, let x G X — 0{x*), and let x^ = ex* + (1 — e)x, e G [0, 1]. Let 
x^i be the point where x^ intersects the boundary of 0{x*), and note that to prove our claim we 
only need to consider the case that, for all ei, e2 G [e', 1] with ei < 62 we have that /(x^j) > f{x^^), 
in which case f{x*) = f{x^i) and, therefore, x^/ G X* . From this point on the proof is completely 
analogous to that of Theorem |6j D 

The converse of the previous theorem does not hold in general and, therefore, the concept 
of almost strict minimality does not characterize the concept of minimality. The next section is 
devoted to studying such a counterexample. 

4 Atypical solutions of polytropic optimization 

In this section, we study an optimization problem whose solution has atypical structure. The 
problem is that of optimizing /(x) = xsin(l/x),x G M (shown in Figure Hi). Note that / is 
differentiable everywhere except the origin where it is continuous. Note also that the solution 
of the scalar polyorder of / is different from the solution of its vector polyorder, although both 
solutions have similar structure. 

What is peculiar about the problem of optimizing / is that the critical element x = is both 
minimal and maximal (in both polyorders) without being a local minimum or a local maximum (in 
either polyorder), however, it satisfies our definition of optimality because there exists neither a 
descent nor an ascent path on either side. 

In spite of the origin's atypical behavior, the optimal solutions of / have a particularly attractive 
property once we view them as a set, namely, they are "setwise locally dominant" in that there 
exists a neighborhood of the set of minimal elements such that every element in this neighborhood 
is either minimal or it is dominated by a minimal element. 

We also consider the dynamical system dx/dt = — /(x). Looked at from a dynamical systems 
perspective, the origin is similarly peculiar: For one thing, it is neither an isolated point of the set 
of critical elements, as any neighborhood contains infinitely many critical elements, nor an interior 
point of that set. What's more, to approach the origin starting at any xq 7^ a physical system 
navigating / has to "reverse" its evolution rule an infinite number of times, and on the grounds of 
this observation, we may, therefore, informally say that the origin would practically be "spaced out" 
for most physical systems. However, we show that the set of minimal elements is asymptotically 
stable as a set. 
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Figure 4: The graph of f{x) = xsm(l/x). 

4.1 Optimal solutions of xsin(l/x) 

Lemma 3. Let f -.M. ^M be continuous, let x* be an isolated critical point of f, and suppose f is 
differentiable in a neighborhood of x* . Then, if f'(x*) > 0, x* is minimal, whereas if f'{x*) < 0, 
X* is maximal. 

Proof. Suppose f'{x*) > 0. It suffices to show, for all x G M — {x*}, there exists e G [0, 1] such that 
X* f{xe) < xf{x^). Expanding / around x* we have that f{x^) = f'{x*){x^ — x*) + o(|xe — x*\'^) 
and, therefore, that {x* - x)f{x^) = (1/1 - e)(x* - x^)f{x^) ss -(1/1 - e)(x* - Xe)'^f'{x*) < in a 
neighborhood of x* . The proof that x* is maximal if f'{x*) < is analogous. D 

Theorem 9. Viewing f{x) = xsin(l/2;) as a vector field, the set of its minimal elements is 

X^j^ = {l/mT\n = 1, 3, 5, . . .} U {0} U {l/n7r|n = -2, -4, -6, . . .}, 
and the set of its maximal elements is 
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{l/mr\n = 2, 4, 6, . . .} U {0} U {l/n7r|n = -1, -3, -5, . . .}. 



Proof. The critical points of / are {0} U {l/mr\n = ±1, ±2, ±3, . . .}. Note now that every critical 
point except the origin is an isolated point and that / is differentiable everywhere except at 0. 
Therefore, we may use Lemma [3] to characterize all critical points except the origin. To show 
that the elements of X^:^^ — {0} are minimal and that the elements of X^^^ — {0} are maximal 
is then a matter of simple calculus. Consider now the origin. To show that the origin is both 
minimal and maximal it suffices to show that, for all x G M — {0}, there exists e G [0, 1] such that 
< xf{x^) <^ sin(l/xe) > and e' G [0, 1] such that > xf{xei) ^ sin(l/2;e') < 0. Both properties 
follow by elementary properties of the sinusoidal function. D 



15 



4.2 Minimal elements are setwise locally dominant 

Proposition 8. Every non-minimal element of the interval [— l/vr, +00) is dominated by a minimal 
element. 

Proof. First we show that the "rightmost" minimal element, that is, minimal element x* = l/vr, 
dominates every element in the interval (l/vr, +00). Letting x £ (l/vr,+c«), it suffices to show 
that (x* — x)f{x) < 0, which holds since x* < x and /(x) > 0. Next we show that the same 
minimal element dominates every element in the interval (l/2vr, l/vr). Letting x G (l/2vr, l/vr), 
it suffices to show that (x* — x)/(x) < 0, which holds since x* > x and /(x) < 0. Now we 
show that the minimal element x* = l/{2k + l)vr, k = 1, 2, 3, . . . dominates every element in the 
intervals (1/(2A; + l)vr, l/2/c7r) and (l/2(/c + l)vr, l/{2k + l)vr). Again it is suffices to show that 
(x* — x)/(x) < where x is any element in one of those intervals. If x G (1/(2A; + l)vr, l/2/i:7r), 
then X* < X and /(x) > (to see this note that since x* is minimal /'(x*) > 0) whereas if 
X G (l/2(fc + l)vr, \/{2k + l)vr) then x* > x and /(x) < 0. Therefore, every element on the right 
halfline is either minimal or it is dominated by a minimal element. The proof for the left halfline 
is similar, noting that x* = —l/vr is maximal, and, therefore, it is dominated by every element in 
the interval (—00, —l/vr). D 

4.3 Minimal elements are setwise asymptotically stable 
4.3.1 Preliminaries 

Following [S], consider the differential equation 

X = F{x) (3) 

where F : X (Z M™ — )• M™ and X is open in M™. Let x* be an equilibrium of this equation (that is, 
an element of X such that F{x*) = 0). We call x* a stable equilibrium if for every neighborhood 
O C X of X* there is a neighborhood O' C X of x* such that every solution x{t) with x(0) G O is 
defined and is in O' for all t > 0. If O' can be chosen so that in addition to the previous property, 
lim(_!.+oo x{t) = X* , then x* is asymptotically stable. 

Theorem 10 (See [2]). Let x* be an equilibrium of (|3|. Let L : O ^ M. be continuous function 
defined on a neighborhood OCX of x* , differentiable on O — x* , such that L[x*) = 0, L{x) > if 
X ^ X* , and L < in O — x* . Then x* is stable. If also L < in O — x* , then x* is asymptotically 
stable. 

Following [15j, let X* C X be a closed set, and call O C X a neighborhood of X* if it open 
relative to X and contains X*. Call X* Lyapunov stable under (pi) if for every neighborhood O of 
X* there exists a neighborhood O' of X* such that every solution {xt} that start in O' is contained 
in O: that is, xq G O' implies that Xt £ O for all i > 0. X* is attracting if there is a neighborhood 
O of X* such that every solution that starts in O converges to X*: that is, xq G O implies that 
Lo{{xt}) C X*. X* is globally attracting if it is attracting with O = X. Finally, the set X* is 
asymptotically stable if it is Lyapunov stable and attracting, and it is globally asymptotically stable 
if it is Lyapynov stable and globally attracting. 

Theorem 11 (See [E]). Let X* C X 6e closed, and let O '^ X be a neighborhood of X* . Let 
L : O -)■ R+ be C^ with L-^{0) = X* . If L{x) = VL{xyF{x) < for all O - X* , the X* is 
asymptotically stable under ([3]). If in addition O = X, then X* is globally asymptotically stable 
under ([s]). 
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4.3.2 Minimal elements are setwise asymptotically stable 

Theorem 12. X^^:^^, the set of minimal elements of f{x) = xsin(l/x),x G M, is asymptotically 
stable under x = —xsva.{l/x). 

In the proof of this theorem we are going to need the fohowing lemma. 

Lemma 4. Let x = —f{x). Then we have: 

(i) l/vr is globally asymptotically stable in (l/27r,+oo). 

(ii) l/(2/c + l)7r, fe = 1, 2, . . . is globally asymptotically stable in {l/2kTT, l/2{k + l)'/r). 

(Hi) —l/2kiT, k = 1,2, . . . is globally asymptotically stable in { — l/{2k — \)tt, —l/{2k + l)7r). 

Proof. To prove part (i), let Li/^(x) = J^, f{y)dy. Then L(1/-k) = 0, L'{x) = f{x), and L{x) = 
— /^(x). Therefore, L{x) < 0, x / l/vr, which proves part (i). The proof of part (ii) is derived using 
a similar line of reasoning using -^i/(2fc+i)7r(3;) = Jii(2k+i)-K fiv)'^y ^"^^ likewise for part (iii). D 



Proof of Theorem 12. Since, by Lemma Ul every solution that starts in (— l/7r,+oo) remains in 
this set, XjJ^jjj is Lyapunov stable. What's more, by the same lemma, every solution that starts in 
(—l/vr, +oo) converges to X"^^^. Therefore, X"^:^^ is asymptotically stable. D 

5 Related work 

To the extent of our knowledge, this is the first paper that proposes a general theory of equilibrium 
behavior in vector fields. Our theory builds upon various related ideas in the literature perhaps the 
most significant of which are the formalization of the variational inequality problem, the concept of 
invasion in evolutionary game theory and the concept of descent algorithms in nonlinear optimiza- 
tion theory, and last but not least order theory. It is difficult to trace the origins and evolution of 
these ideas in one paper (for example, optimization theory's necessary optimality conditions date 
as far back as 1637; see [Ij), and we defer from providing definitive references. 

5.1 The variational inequality problem 

The variational inequality problem captures the notion of equilibrium in its generality and repre- 
sents, in our view, the first attempt to formalize a general theory of equilibrium behavior. How- 
ever, our theory refines the concept of variational equilibrium in a strong sense. According to their 
variational formalization, equilibria are precisely those points that lack (a generalized notion of) 
directions of strict descent. In contrast, minimal elements are precisely those points that lack (a 
generalized notion of) directions of descent. Since points that lack directions of descent clearly 
lack directions of strict descent, minimal elements are a variational equilibrium refinement concept. 
Therefore, the concept of variational equilibrium is a necessary condition in any fixed (equilibrium) 
solution of a vector field, however, we have argued extensively that this concept cannot serve as a 
general solution concept in vector fields. 

5.2 Nonlinear optimization theory and game theory 

One of the main contributions of this paper is to explore the precise relationship between evolu- 
tionary game theory and nonlinear optimization theory: Drawing on the link that the variational 
inequality problem establishes between the equilibrium concepts of these theories, this is the first 
paper to establish a relationship between the evolutionarily stable state and the strict local mini- 
mum. However, our contribution extends beyond establishing this relationship to extending both 
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theories through proposing an overarching solution concept (of which both the evohitionarily stable 
state and the strict local minimum are special cases). 

At a more elementary conceptual level, we believe that evolutionary game theory's most sig- 
nificant contribution in the study of equilibrium behavior is the concept of evolutionary stability, 
and although there are many alternative formalizations of this concept, they have been shown to 
be equivalent. These formalizations are all based on the more elementary concept of invasion. Our 
theory is based instead on the elementary concept of dominance, which furnishes a solution concept 
that generalizes the concept of evolutionary stability in a strong sense. 

Similarly, nonlinear optimization theory's formalizations are based on the elementary concept 
of a direction of strict descent whereas our theory is based instead on the concept of a descent path 
(that is germane to the concept of dominance). This change in perspective furnishes a solution 
concept that generalizes nonlinear optimization theory's solution concepts. 

5.3 Order theory 

The concept of a polyorder draws heavily on ideas from order theory, a discipline which is concerned, 
however, with the study of transitive binary relations (see, for example, |12)). whereas polyorders 
are generally not transitive. As discussed earlier, there is an increasing body of work on acyclic 
binary relations, a concept that relaxes the concept of transitivity. Although scalar polyorders are 
acyclic (Proposition^, the rich structure of scalar polyorders warrants independent scrutiny. 

Acknowledgments 

I would like to thank Jon Crowcroft for carefully listening many of my arguments. 

References 

[1] J. C. R. Alcantud. Characterization of the existence of maximal elements of acyclic relations. 
Economic Theory, 19:407-416, 2002. 

[2] T. Bergstrom. Maximal elements of acyclic relations on compact sets. Journal of Economic 
Theory, 10:403-404, 1975. 

[3] D. Bertsekas and J. Tsitsiklis. Parallel and Distributed Computation: Numerical Methods. 
Prentice Hall, 1989. 

[4] D. P. Bertsekas. Nonlinear Programming. Athena Scientific, second edition, 1999. 

[5] D. P. Bertsekas, A. Nedic, and A. E. Ozdaglar. Convex Analysis and Optimization. Athena 
Scientific, 2003. 

[6] S. Boyd and L. Vandenberghe. Convex Optimization. Cambridge University Press, 2004. 

[7] C. Daskalakis, P. W. Goldberg, and C. H. Papadimitriou. The complexity of computing a 
Nash equilibrium. SIAM J. Comput., 39(l):195-259, 2009. 

[8] P. Dupuis and A. Nagurney. Dynamical systems and variational inequalities. Annals of Oper- 
ations Research, 44:9-42, 1993. 

[9] M. W. Hirsch and S. Smale. Differential Equations, Dynamical Systems, and Linear Algebra. 
Academic Press, 1974. 

18 



[10] A. Mas-Colell, M. D. Whinston, and J. R. Green. Microeconomic Theory. Oxford University 
Press, 1995. 

[11] J. Von Neumann and O. Morgernstern. Theory of Games and Economic Behavior. Princeton 
University Press, 1953. 



[12] E. A. Ok. Elements of Order Theory, 2012. https://files.nyu.edu/eol/public/books, 
Ihtmll 

[13] H. Salonen and H. Vartiainen. On the existence of undoniinated elements of acyclic relations. 
Mathematical Social Sciences., 60:217-221, 2010. 

[14] W. Sandholm. Potential games with continuous player sets. Journal of Economic Theory, 
97:81-108, 2001. 

[15] W. H. Sandholm. Population Games and Evolutionary Dynamics. MIT Press, 2010. 

[16] J. Maynard Smith. Evolution and the Theory of Games. Cambridge University Press, 1982. 

[17] J. Maynard Smith and G. R. Price. The logic of animal conflict. Nature, 246:15-18, 1973. 

[18] P. Taylor and L. Jonker. Evolutionary stable strategies and game dynamics. Mathematical 
Biosciences, 16:76-83, 1978. 

[19] B. Thomas. On evolutionarily stable sets. J. Math. Biology, 22:105-115, 1985. 

[20] M. Walker. On the existence of maximal elements. Journal of Economic Theory, 16:470-474, 
1977. 

[21] J. W. Weibull. Evolutionary Game Theory. MIT Press, 1995. 



19 



